TedTest

From the Ted Talk by Katherine Kuchenbecker: The technology of touch

Unscramble the Blue Letters

I'm a mechanical engineering professor at the University of Pennsylvania, and my favorite hboby is photography. And as I travel around the world, I love taking photographs like these, so I can remember all the beautiful and interesting things that I've seen. But what I can't do is reocrd and share how these objects feel to touch. And that's kind of srpiuisrng, because your sense of touch is really important. It's involved in every physical interaction you do every day, every manipulation task, anything you do in the world. So the sense of touch is actually pretty itrstenieng. It has two main components. The first is tactile sensations, things you feel in your skin. And the second is kinesthetic saonitnses. This has to do with the position of your body and how it's moving, and the forces you encounter. And you're really good at incorporating both of these types of sensations together to uadnestrnd the physical interactions you have with the wlrod and understand as you tuoch a surface: is it a rock, is it a cat, is it a bunny, what is it? And so, as an eginneer, I'm really factisaend and I have a lot of respect for how good pelpoe are with their hdans. And I'm intrigued and coruius about whether we could make technology better by doing a better job at leveraging the human cabtpaliiy with the snese of touch. Could I improve the interfaces to courmepts and machines by lintteg you take advantage of your hands? And indeed, I think we can, and that's at the core of a field caelld haptics, and this is the area that I work in. It's all about interactive touch technology. And the way it works is, as you move your body through the world, if, as an engineer, I can make a system that can measure that motion, and then present to you sensations over time that kind of make sense, that macth up with what you might feel in the real world, I can fool you into thinking you're touching something even though there's nothing there. So here are three examples and these are all done from research in my lab at Penn. The first one is all about that same problem that I was showing you: how can we capture how ojetbcs feel and recreate those experiences? So the way we solve this problem is by creating a hand-held tool that has many different sensors inside. It has a force sensor, so we can tell how hard you're pushing; it has motion tkcniarg, so we can tell exactly where you've moved it; and it has a vibration sensor, an accelerometer, inside, that detects the shaking back and forth of the tool that lets you know that's a piece of canvas and not a piece of silk or something else. Then we take the data we record from these interactions. Here's ten seconds of data. You can see how the vbaotiirns get larger and slmaelr, depending on how you move. And we make a mathematical model of those relationships and proragm them into a tablet computer so that when you take the stylus and go and touch the screen, that voice-coil actuator in the white bracket plays vibrations to give you the isliuoln that you're tinhoucg the real surface, just like if you touched, dgrgaed back and forth, on the real canvas. We can cetare very compelling illusions. We can do this for all kinds of surfaces and it's really a lot of fun. We call it haptography — haptic phtrhopaogy. And I think it has potential benefits in all srots of areas like online sponhipg, maybe interactive museum exhibits, where you're not supposed to touch the precious aifctarts, but you always want to. The second example I want to tell you about comes from a collaboration I have with Dr. Margrit Maggio at the Penn Dental School. Part of her job is to teach dental suendtts how to tell where in a patient's mutoh there are cavities. Of course they look at X-rays, but a large part of this caniilcl judgment comes from what they feel when they touch your teeth with a dental explorer. You've all had this happen, they go across. What they're feeling for is if the tooth is really hard, then it's hleathy, but if it's kind of soft and sticky, that's a signal that the eneaml is starting to decay. These types of jgdutmens are hard for a new dental setudnt to make, because they haven't touched a lot of teeth yet. And you want them to learn this before they start practicing on real human patients. So what we do is add an accelerometer on to the dental explorer, and then we record what Dr. Maggio feels as she touches different extracted teeth. And we can play it back for you as a video with a touch track — not just a sunod track, but also a touch track, that you can feel by holding that repeating tool. You feel the same things the dentist felt when they did the recording, and practice making judgments. So here's a sample one. Here's a tooth that looks kind of suspicious, right? It has all those brown stains. You might be tnkinhig, "We should definitely put a filling in this tooth." But if you pay attention to how it feels, all the surfaces of this tooth are hard and healthy, so this patient does not need a filling. And these are exactly the kind of judgments doctors make every day and I think this thnoogcley we've inntveed has a lot of potential for many different things in medical training, because it's really simple and it does a great job at retecriang what people feel through tools. I think it could also help make games more interactive and fun and more realistic in the sensations that you feel. The last example I want to tell you about is again about human mmoevnet. So if any of you have ever learned sports, how do you get good at something like surfing? You practice. You practice some more and more, right? Making small corrections, maybe getting some iupnt from a coach, learning how to improve your motions. I think we could use computers to help make that process more efficient and more fun. And so here, for example, if I have six different arm mtvnomees that I want you to laren, you come into my lab at Penn and try out our system. We use a Kinect to measure your motions, we show graphics on the srecen, and then we also give you touch cues, haptic feedback on your arm, delivered by these haptic arm bands which have motors inside, and gduie you as you move. So, if we put it together, as you're trying to track this mioton, if you deviate — say, maybe, your arm is a little too high — we turn on the motors right there on the skin to let you know you should move down, almost like a coach gently guiding you and hilenpg you master these movements more quickly and make more precise corrections. We dvelepeod this system for use in stroke rehabilitation, but I think there are a lot of applications, like maybe dance training or all sorts of sports training as well. So now you know a little bit about the filed of haptics, which I think you'll hear more about in the coming yares. I've sowhn you three epxaemls. I just want to take a moment to aokgnecldwe the great students who work with me in my lab at Penn and my collaborators. They're a great gourp. I also want to thank you for your kind attention. (Applause)

Open Cloze

I'm a mechanical engineering professor at the University of Pennsylvania, and my favorite _____ is photography. And as I travel around the world, I love taking photographs like these, so I can remember all the beautiful and interesting things that I've seen. But what I can't do is ______ and share how these objects feel to touch. And that's kind of __________, because your sense of touch is really important. It's involved in every physical interaction you do every day, every manipulation task, anything you do in the world. So the sense of touch is actually pretty ___________. It has two main components. The first is tactile sensations, things you feel in your skin. And the second is kinesthetic __________. This has to do with the position of your body and how it's moving, and the forces you encounter. And you're really good at incorporating both of these types of sensations together to __________ the physical interactions you have with the _____ and understand as you _____ a surface: is it a rock, is it a cat, is it a bunny, what is it? And so, as an ________, I'm really __________ and I have a lot of respect for how good ______ are with their _____. And I'm intrigued and _______ about whether we could make technology better by doing a better job at leveraging the human __________ with the _____ of touch. Could I improve the interfaces to _________ and machines by _______ you take advantage of your hands? And indeed, I think we can, and that's at the core of a field ______ haptics, and this is the area that I work in. It's all about interactive touch technology. And the way it works is, as you move your body through the world, if, as an engineer, I can make a system that can measure that motion, and then present to you sensations over time that kind of make sense, that _____ up with what you might feel in the real world, I can fool you into thinking you're touching something even though there's nothing there. So here are three examples and these are all done from research in my lab at Penn. The first one is all about that same problem that I was showing you: how can we capture how _______ feel and recreate those experiences? So the way we solve this problem is by creating a hand-held tool that has many different sensors inside. It has a force sensor, so we can tell how hard you're pushing; it has motion ________, so we can tell exactly where you've moved it; and it has a vibration sensor, an accelerometer, inside, that detects the shaking back and forth of the tool that lets you know that's a piece of canvas and not a piece of silk or something else. Then we take the data we record from these interactions. Here's ten seconds of data. You can see how the __________ get larger and _______, depending on how you move. And we make a mathematical model of those relationships and _______ them into a tablet computer so that when you take the stylus and go and touch the screen, that voice-coil actuator in the white bracket plays vibrations to give you the ________ that you're ________ the real surface, just like if you touched, _______ back and forth, on the real canvas. We can ______ very compelling illusions. We can do this for all kinds of surfaces and it's really a lot of fun. We call it haptography — haptic ___________. And I think it has potential benefits in all _____ of areas like online ________, maybe interactive museum exhibits, where you're not supposed to touch the precious _________, but you always want to. The second example I want to tell you about comes from a collaboration I have with Dr. Margrit Maggio at the Penn Dental School. Part of her job is to teach dental ________ how to tell where in a patient's _____ there are cavities. Of course they look at X-rays, but a large part of this ________ judgment comes from what they feel when they touch your teeth with a dental explorer. You've all had this happen, they go across. What they're feeling for is if the tooth is really hard, then it's _______, but if it's kind of soft and sticky, that's a signal that the ______ is starting to decay. These types of _________ are hard for a new dental _______ to make, because they haven't touched a lot of teeth yet. And you want them to learn this before they start practicing on real human patients. So what we do is add an accelerometer on to the dental explorer, and then we record what Dr. Maggio feels as she touches different extracted teeth. And we can play it back for you as a video with a touch track — not just a _____ track, but also a touch track, that you can feel by holding that repeating tool. You feel the same things the dentist felt when they did the recording, and practice making judgments. So here's a sample one. Here's a tooth that looks kind of suspicious, right? It has all those brown stains. You might be ________, "We should definitely put a filling in this tooth." But if you pay attention to how it feels, all the surfaces of this tooth are hard and healthy, so this patient does not need a filling. And these are exactly the kind of judgments doctors make every day and I think this __________ we've ________ has a lot of potential for many different things in medical training, because it's really simple and it does a great job at __________ what people feel through tools. I think it could also help make games more interactive and fun and more realistic in the sensations that you feel. The last example I want to tell you about is again about human ________. So if any of you have ever learned sports, how do you get good at something like surfing? You practice. You practice some more and more, right? Making small corrections, maybe getting some _____ from a coach, learning how to improve your motions. I think we could use computers to help make that process more efficient and more fun. And so here, for example, if I have six different arm _________ that I want you to _____, you come into my lab at Penn and try out our system. We use a Kinect to measure your motions, we show graphics on the ______, and then we also give you touch cues, haptic feedback on your arm, delivered by these haptic arm bands which have motors inside, and _____ you as you move. So, if we put it together, as you're trying to track this ______, if you deviate — say, maybe, your arm is a little too high — we turn on the motors right there on the skin to let you know you should move down, almost like a coach gently guiding you and _______ you master these movements more quickly and make more precise corrections. We _________ this system for use in stroke rehabilitation, but I think there are a lot of applications, like maybe dance training or all sorts of sports training as well. So now you know a little bit about the _____ of haptics, which I think you'll hear more about in the coming _____. I've _____ you three ________. I just want to take a moment to ___________ the great students who work with me in my lab at Penn and my collaborators. They're a great _____. I also want to thank you for your kind attention. (Applause)

Solution

mouth
input
screen
clinical
hands
acknowledge
shopping
vibrations
hobby
people
capability
group
student
thinking
judgments
record
movement
smaller
touch
motion
match
surprising
invented
sensations
objects
helping
guide
shown
examples
called
enamel
engineer
learn
curious
create
developed
years
tracking
fascinated
artifacts
sense
computers
technology
illusion
understand
sound
world
letting
recreating
field
program
dragged
interesting
touching
sorts
healthy
movements
photography
students

Original Text

I'm a mechanical engineering professor at the University of Pennsylvania, and my favorite hobby is photography. And as I travel around the world, I love taking photographs like these, so I can remember all the beautiful and interesting things that I've seen. But what I can't do is record and share how these objects feel to touch. And that's kind of surprising, because your sense of touch is really important. It's involved in every physical interaction you do every day, every manipulation task, anything you do in the world. So the sense of touch is actually pretty interesting. It has two main components. The first is tactile sensations, things you feel in your skin. And the second is kinesthetic sensations. This has to do with the position of your body and how it's moving, and the forces you encounter. And you're really good at incorporating both of these types of sensations together to understand the physical interactions you have with the world and understand as you touch a surface: is it a rock, is it a cat, is it a bunny, what is it? And so, as an engineer, I'm really fascinated and I have a lot of respect for how good people are with their hands. And I'm intrigued and curious about whether we could make technology better by doing a better job at leveraging the human capability with the sense of touch. Could I improve the interfaces to computers and machines by letting you take advantage of your hands? And indeed, I think we can, and that's at the core of a field called haptics, and this is the area that I work in. It's all about interactive touch technology. And the way it works is, as you move your body through the world, if, as an engineer, I can make a system that can measure that motion, and then present to you sensations over time that kind of make sense, that match up with what you might feel in the real world, I can fool you into thinking you're touching something even though there's nothing there. So here are three examples and these are all done from research in my lab at Penn. The first one is all about that same problem that I was showing you: how can we capture how objects feel and recreate those experiences? So the way we solve this problem is by creating a hand-held tool that has many different sensors inside. It has a force sensor, so we can tell how hard you're pushing; it has motion tracking, so we can tell exactly where you've moved it; and it has a vibration sensor, an accelerometer, inside, that detects the shaking back and forth of the tool that lets you know that's a piece of canvas and not a piece of silk or something else. Then we take the data we record from these interactions. Here's ten seconds of data. You can see how the vibrations get larger and smaller, depending on how you move. And we make a mathematical model of those relationships and program them into a tablet computer so that when you take the stylus and go and touch the screen, that voice-coil actuator in the white bracket plays vibrations to give you the illusion that you're touching the real surface, just like if you touched, dragged back and forth, on the real canvas. We can create very compelling illusions. We can do this for all kinds of surfaces and it's really a lot of fun. We call it haptography — haptic photography. And I think it has potential benefits in all sorts of areas like online shopping, maybe interactive museum exhibits, where you're not supposed to touch the precious artifacts, but you always want to. The second example I want to tell you about comes from a collaboration I have with Dr. Margrit Maggio at the Penn Dental School. Part of her job is to teach dental students how to tell where in a patient's mouth there are cavities. Of course they look at X-rays, but a large part of this clinical judgment comes from what they feel when they touch your teeth with a dental explorer. You've all had this happen, they go across. What they're feeling for is if the tooth is really hard, then it's healthy, but if it's kind of soft and sticky, that's a signal that the enamel is starting to decay. These types of judgments are hard for a new dental student to make, because they haven't touched a lot of teeth yet. And you want them to learn this before they start practicing on real human patients. So what we do is add an accelerometer on to the dental explorer, and then we record what Dr. Maggio feels as she touches different extracted teeth. And we can play it back for you as a video with a touch track — not just a sound track, but also a touch track, that you can feel by holding that repeating tool. You feel the same things the dentist felt when they did the recording, and practice making judgments. So here's a sample one. Here's a tooth that looks kind of suspicious, right? It has all those brown stains. You might be thinking, "We should definitely put a filling in this tooth." But if you pay attention to how it feels, all the surfaces of this tooth are hard and healthy, so this patient does not need a filling. And these are exactly the kind of judgments doctors make every day and I think this technology we've invented has a lot of potential for many different things in medical training, because it's really simple and it does a great job at recreating what people feel through tools. I think it could also help make games more interactive and fun and more realistic in the sensations that you feel. The last example I want to tell you about is again about human movement. So if any of you have ever learned sports, how do you get good at something like surfing? You practice. You practice some more and more, right? Making small corrections, maybe getting some input from a coach, learning how to improve your motions. I think we could use computers to help make that process more efficient and more fun. And so here, for example, if I have six different arm movements that I want you to learn, you come into my lab at Penn and try out our system. We use a Kinect to measure your motions, we show graphics on the screen, and then we also give you touch cues, haptic feedback on your arm, delivered by these haptic arm bands which have motors inside, and guide you as you move. So, if we put it together, as you're trying to track this motion, if you deviate — say, maybe, your arm is a little too high — we turn on the motors right there on the skin to let you know you should move down, almost like a coach gently guiding you and helping you master these movements more quickly and make more precise corrections. We developed this system for use in stroke rehabilitation, but I think there are a lot of applications, like maybe dance training or all sorts of sports training as well. So now you know a little bit about the field of haptics, which I think you'll hear more about in the coming years. I've shown you three examples. I just want to take a moment to acknowledge the great students who work with me in my lab at Penn and my collaborators. They're a great group. I also want to thank you for your kind attention. (Applause)

Frequently Occurring Word Combinations

ngrams of length 2

collocation	frequency
objects feel	2

Important Words

accelerometer
acknowledge
actuator
add
advantage
applause
applications
area
areas
arm
artifacts
attention
bands
beautiful
benefits
bit
body
bracket
brown
bunny
call
called
canvas
capability
capture
cat
cavities
clinical
coach
collaboration
collaborators
coming
compelling
components
computer
computers
core
corrections
create
creating
cues
curious
dance
data
day
decay
delivered
dental
dentist
depending
detects
developed
deviate
doctors
dr
dragged
efficient
enamel
encounter
engineer
engineering
examples
exhibits
experiences
explorer
extracted
fascinated
favorite
feedback
feel
feeling
feels
felt
field
filling
fool
force
forces
fun
games
gently
give
good
graphics
great
group
guide
guiding
hands
happen
haptic
haptics
haptography
hard
healthy
hear
helping
high
hobby
holding
human
illusion
illusions
important
improve
incorporating
input
interaction
interactions
interactive
interesting
interfaces
intrigued
invented
involved
job
judgment
judgments
kind
kinds
kinect
kinesthetic
lab
large
larger
learn
learned
learning
lets
letting
leveraging
lot
love
machines
maggio
main
making
manipulation
margrit
master
match
mathematical
measure
mechanical
medical
model
moment
motion
motions
motors
mouth
move
moved
movement
movements
moving
museum
objects
online
part
patient
patients
pay
penn
pennsylvania
people
photographs
photography
physical
piece
play
plays
position
potential
practice
practicing
precious
precise
present
pretty
problem
process
professor
program
put
quickly
real
realistic
record
recording
recreate
recreating
rehabilitation
relationships
remember
repeating
research
respect
rock
sample
school
screen
seconds
sensations
sense
sensor
sensors
shaking
share
shopping
show
showing
shown
signal
silk
simple
skin
small
smaller
soft
solve
sorts
sound
sports
stains
start
starting
sticky
stroke
student
students
stylus
supposed
surface
surfaces
surfing
surprising
suspicious
system
tablet
tactile
task
teach
technology
teeth
ten
thinking
time
tool
tools
tooth
touch
touched
touches
touching
track
tracking
training
travel
turn
types
understand
university
vibration
vibrations
video
white
work
works
world
years